-UJ. 

: n 

s <X> 
i Q 

1 c 
1 w 



I -1 



Q 

:<x> 



CMCF\ 



=o 



UTILITY 


Attorney Docket No.: 


D/A0047 


Total Pages: 







PATENT APPLICATION 


First Named Inventor or Application identifier 




TRANSMITTAL 


Christopher R. Dance et a! 




(Only for new nonprovisional applications 
under 37 CFR 1 .53(b) 


Express Mail Label No.: 







APPLICATION ELEMENTS 

See MPEP Chapter 600 concerning 
utility patent application contents. 



ADDRESS TO: 



Commissioner for Patents 
Box Patent Application 
Washington, DC 20231 



1 . 1X1 Fee Transmittal Form 

(Submit an original, and a duplicate for fee 
processing) 



2. 122 Specification (incl. claims) (Total Pages: 11) 

3. Drawing(s) (35 USC 1 1 3) (Total Sheets: 5) 
Rl Informal Q Formal 



4. CH Oath or Declaration (Total Pages. ) 

a. CH Newly executed 

(original or copy) 

b. C] Copy from a prior application (37 CFR 1 .63(d)) 

(for continuation/divisional with Box 17 completed) 
[Note Box 5 below] 

□ i DELETION OF INVENTORY 

Signed statement attached deleting 
Inventor(s) named in the prior application, 
see 37 CFR 1 .63(d)(2) and 1 .33(b). 



I I Incorporation By Reference 
(usable if Box 4b is checked) 

The entire disclosure of the prior application, from 
which a copy of the oath or declaration is supplied 
under Box 4b, is considered as being part of the 
disclosure of the accompanying application and is 
hereby incorporated by reference therein. 



6. CD Microfiche Computer Program (Appendix) 



7. Nucleotide and/or Amino Acid Sequence Submission 
(If applicable, all necessary) 

a- U] Computer Readable Copy 

Paper Copy (Identical to computer copy) 
c CI Statement verifying identity of above copies 



ACCOMPANYING APPLICATION PARTS 



8. CD Assignment Papers (cover sheet & document(s)) 

9- C] 37 CFR 3.73(b) Statement □ Power of Attorney 
(when there is an assignee) 

10. English Translation Document (if applicable) 



11. C3 information Disclosure 

Statement (!DS)/PTO-1449 

12. O Preliminary Amendment 
13 



□ Copies of IDS 
Cftations 



Return Receipt Postcard (MPEP 503) 
(Shouid be specifically itemized) 



14. □ Small Entity 
Statement(s) 



I I Statement filed in prior application, 
Status still proper and desired 



15. □ Certified Copy of Priority Document(s) 

(If foreign priority is claimed) 

16. □ Other 



17. O If a CONTINUING APPLICATION, check appropriate box and supply the requisite information; 

□ Continuation O Divisional O Continuation-in-part (CIP) of prior application No. / 



18. CORRESPONDENCE ADDRESS 



□ Same as prior application D<] Correspondence address below 



NAME 


John E. Beck 


ADDRESS 


Xerox Corporation, Xerox Square - 20 A 


CITY 


Rochester 


STATE 


NY 


ZIP CODE 


14644 


COUNTRY 


U.S A 


TELEPHONE 


+33 476615112 


FAX 


716-423-5240 or 
716-423-2750 



Page 1 of 3 



Xerox Rev. 10/21(00 



UTILITY PATENT APPLICATION TRANSMITTAL - 37 CFR 1.53(b) Pagc^ 1 

(Executed Attachment to Page 1 ) ^"^a * 

Attorney Docket No. D/A0047 

19. Q Cancel in this application original claims: of the prior application before calculating the filing fee. 

(At least one original independent claim is retained for this filing). 



20. H The filing fee is calculated below: 



Claims As Filed, Less Any Claims Canceled By above-indicated Amendment(s) 


(l)FOR 


(2) Number Filed 


(3) Number Extra 


(4) Rate 


(5) Calculations 


Total Claims 
(37 CFR 1 16(c)) 


17 -20 = 


0 


X $ 18 


= $0,00 


Independent Claims 
(37 CFR 1 16(b)) 


3 -3 = 


0 


X $80 


= $0.00 


Multiple Dependent 
Clmms (if applicable) 
(37 CFR 1 16(d)) 




ANY - - 0 


$270 


- $0.00 


Basic Fee (37 CFR I 16(a)) 


$710.00 


Total 


$ 710.00 



21 . [3 The Commissioner is hereby authorized to charge any filing or prosecution fees which may be required, 

under 37 CFR LI 6, LI 7, and 1 .21 (but not 1.18), or to credit any overpayment, to Xerox Corporation, 
Account No. 24-0025. An additional copy of this form is enclosed. 

22. ^ This is an authorization under 37 CFR LI 36(a)(3) to treat any concurrent or future reply, requiring a 

petition for extension of time, as incorporating a petition for the appropriate extension of time. 

23. O Amend the specification by inserting before the first line the sentence: 

—This application is a Q continuation Q continuation-in-part O divisional 
of Application(s) No(s). , filed 

24. O A CIP declaration is enclosed. 

25. O Power of Attorney 

a. Q The power of attorney appears in the original papers of the enclosed prior application. 

b. Enclosed is a copy of the declaration and power of attorney from the enclosed prior 
application. 

c. O A new declaration with power of attorney is enclosed. 



Page 2 of 3 



Xerox Rev. 10/2000 



UTILITY PATENT APPLICATION TRANSMITTAL - 37 CFR 1.53(b) Page 3 

(Executed Attachment to Page 1 ) 



Attorney Docket No.: D/A0047 

26. The following inventors named in the prior application are deleted per 37 CFR 1 .53(b)(1), 1.63(d)(2) 
and 1 .33 (b): 

27. Q This application is adding one or more inventors under 37 CFR 1 .48 to a previously executed 

application, with an enclosed: petition, fee, newly executed declaration from all inventors, and written 
consent of the assignee. 

28. O This application claims the priority benefit of one or more Provisional Application 

No(s). and the first sentence of this application has been or will be amended to so indicate. 

29. Priority is claimed from 

(reinsert all previous priority claims for the entire chain of any prior applications). 

30. O Other paper(s) enclosed: 



Respectfully submitted, 



Thomas Zell 
Signature per 37 CFR 1 .33 & 34 
Date: 11/ 6fao&o 
Registration No. 37,481 
Telephone No. +33476615 1 1 2 



Page 3 of 3 



Xerox Rev. 10/2000 



Patent Application 
Docket No. D/A0047 



METHOD AND APPARATUS FOR IMAGE CAPTURE, 
SELECTION AND COPYING 

BACKGROUND OF THE INVENTION 
5 1 . Field of the Invention 

The present invention relates to a method and apparatus for use in 
digital image capture, and which permits a region of the captured image to be 
selected and copied, for example to a file, or to a computer's "clipboard", or 
directly into a computer's application program. 

10 2. Description of Related Art 

There are many known apparatus and application programs for 
capturing a digital image of, for example, a document or photograph or scene. 
Such apparatus and programs will often have a display facility for displaying 
the captured image, a selection facility for enabling a region of the image to 
15 be controllably selected, and a copy facility for enabling the selected region to 
be copied to a file, or to a temporary "clipboard", or directly into an application 
program. 

An example of such an application program is CamWorks 4.2 produced 
by Xerox Corporation. This application provides plural selection tools for 
20 enabling a user to specify how the selection of an image region is to be 
performed, to suit the particular image characteristics. For example, for a 
picture image, then a suitable selection tool is a rectangular box selection tool, 
where the user defines a rectangular boundary around the selected region. 

The CamWorks 4.2 application also includes plural copying tools for 
25 enabling the selected region to be copied to a target location, file or 
application. Each time that copying is performed, the user has to specify the 
particular copy tool to be used, for example, "copy as text", "copy as a color 
image", or "copy as a black and white image". This controls how the image 
data is processed, and the type of file generated. 
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Reference is made to the operations manual for CamWorks 4.2, the 
content of which is incorporated herein by reference, to provide technical 
information about the operation of the selection and copying tools. 

As indicated above, many other forms of image capture apparatus and 
5 application programs are known in the art. Reference may be made, for 
example, to U.S. Patent No. 5,715,501 which relates to a digital copier, and to 
U.S. Patent No. 5,937,232 which relates to image processing. 

SUMMARY OF THE INVENTION 

Broadly speaking, one aspect of the present invention is to provide 
10 image control modes which control, at least in a default situation, a selection 
tool for selecting a region of an image, and a copying tool for copying the 
selected region of the image. 

The control mode may be regarded as a global mode for controlling the 
choice of selection tools automatically. This requires minimal user input, and 
15 allows consistent repeated actions. 

Preferably, the modes include at least one text mode, and at least one 
picture mode. Preferably the picture modes include a black-and-white 
(monochromatic) picture mode, and a color picture mode. 

By using modes, the most suitable selection tool and the most suitable 
20 copying tool are controlled automatically by the image mode selected by the 
user. It is therefore no longer necessary for the user to select (or check) the 
selection tool and the copying tool on each occasion of use. Particularly for 
repetitive situations, such selecting operations are laborious and time 
consuming, and can lead to mistakes or inconsistent use. 

25 In a preferred embodiment, the image control mode also controls the 

display of the image, for example, either as a text image, or as a black-and- 
white picture image, or as a color picture image. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Embodiments of the invention are now described by way of example 
only, with reference to the accompanying drawings, in which: 

Fig. 1 is a schematic block diagram showing the components of an 
5 image capture system; 

Fig. 2 is a schematic block diagram illustrating the functionality in a first 
embodiment; 

Fig. 3 is a schematic control diagram showing the controls affected by 
control modes in the first embodiment; 

10 Fig. 4 is a modified schematic illustration of modes in the first 

embodiment; 

Fig. 5 is a schematic illustration of modes in an alternative modified 
version of the first embodiment; 

Fig. 6 is a schematic block diagram illustrating the functionality of a 
15 second embodiment of the image capture system; and 

Fig. 7 is a schematic control diagram showing the controls affected by 
control modes in the second embodiment. 

DETAILED DESCRIPTION 

Referring to Fig. 1, an image capture and processing system 10 
20 comprises an image capture device 12, a data processor 14, a display device 
16, a manual input device 18. and a data storage memory 20. The image 
capture device 12 may be any form of digital camera, or scanner, or copier for 
generating a digital version of a captured image. The processor 14, display 
device 16, the input device 18 and the memory 20 are typically components of 
25 a computer system executing an image processing application program. 

Fig. 2 illustrates the functionality of a first embodiment of the image 
processing application 22. The application includes an image input section 
24, and image processing section 26. The application also includes a section 
of selection tools 28 for enabling a user to define and select a desired region 
30 of a captured image. The selection tools 28 include a rectangular box 
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selection tool 28a and a word-by- word (or word-to-word) selection tool 28b. 
The rectangular box tool selection tool 28a operates by enabling the user to 
define a rectangular boundary around a desired region. The word-by-word 
(word-to-word) selection tool 28b operates by performing an optical 
5 recognition algorithm to identify word patterns and the spaces between words, 
jhe user can then select a region on a word-by-word basis. A suitable word- 
to-word selection tool is described, for example ; in commonly owned U.S. 
Patent Application Serial No. 09/438,891 entitled "Word-to-Word Selection on 
Images", the content of which is incorporated herein by reference. 

10 The application 22 also includes a section of copy tools 30 for copying 

a selected region, and outputting copied region to the computer's "clipboard" 
for temporary storage, or to a file in the memory 20, or directly into another 
application program running on the computer system. The copy tools include 
a color picture copy tool 30a, a black-and-white (monochrome) picture image 

15 copy tool 30b, and a text image copy tool 30c. Each copy tool generates data 
representing the image in a respective format, being respectively a black-and- 
white format, or a color format, or a text format. 

in this embodiment, the application also includes control of a display 
mode 32, including a color display mode 32a, a black-and-white display mode 

20 32b, and a text display mode 32c. The display mode represents the type of 
display generated on the display device 16. The color display mode 32a is 
typically a picture mode with a color attribute enabled. The black-and-white 
display mode 32b is typically a binary picture mode (e.g. black or white with 
no intermediate gray values). Alternatively, the black-and-white display mode 

25 could be monochromatic with a gray scale (i.e. color disabled). The text 
display mode 32c may be a mode following optical character recognition 
(OCR) of the input image. 

In accordance with the principles of the invention, the application 22 
also includes an image mode input 34, which is set by the user to indicate the 
30 type of image captured. The image mode may be selected from the following: 

(a) color picture mode 

(b) black-and-white picture mode 
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(c) text mode 

The image mode 34 is used to control, at least by default, 
predetermined selections of the display mode 32, the selection tool 28 and the 
copy tool 30c. 

5 Referring to Fig. 3, when the color mode 34a is selected, this sets the 

display mode 32 to be the color display 32a, the selection tool 28 to be the 
rectangular box selection tool 28a, and the copy tool 30 to be the color copy 
tool 30a. 

When the black-and-white mode 34b is selected, this sets the display 
10 mode 32 to be the black-and-white display mode 32b, the selection tool 28 to 
be the rectangular box selection tool 28a, and the copy tool 30 to be the 
black-and-white copy tool 30b. 

When the text mode 34c is selected, this sets the display mode 32 to 
be the text display mode 32c, the selection tool to be the word-by-word 
15 selection tool 28b, and the copy tool 30 to be the text copy tool 30c. 

It is possible to provide the user with a manual override facility to 
modify the default settings to suit a particular situation, but the use of an 
overall mode control setting simplifies operation of the system. This is 
especially advantageous for highly repetitive applications, and can provide for 
20 more efficient operation and control. The risk of accidental selection 
mistakes, or ambiguous copy results, can be significantly reduced. 

Fig. 4 illustrates a modified embodiment in which the application 
program provides two display outputs, a first being a real-time live display 
output 36, and the second being a frozen or "captured" display output 38. In 
25 Fig. 4, both of the display outputs 36 and 38 are operable in a color picture 
mode, a black-and-white picture mode, and a text display mode. The image 
mode 34 is used to control the display mode for both outputs 36 and 38. 

In Fig. 4, a real-time or "live" text display mode is indicated. This may 
be facilitated if binarisation and OCR can be performed fast enough to appear 
30 responsive to changes in the images supplied by the camera. Otherwise, it 
may be possible to track movements of a document in the camera images 
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and to change the position of the displayed text (which allows reuse of the 
previous OCR results). 

The display operation illustrated in Fig. 4 can ensure that a document 
image is always displayed in both the live view and the frozen view, in the 
5 best mode for the document (as set by the control mode 34 selected by the 
user). 

Fig. 5 illustrates a further modified embodiment in which the application 
program again provides two display outputs, the first being a live display 
output 40, and the second being a frozen or captured display output 42. The 

10 outputs 40 and 42, are similar to the outputs 36 and 38, respectively, 
discussed above except that the live output 40 operates only in a fixed, color 
display mode. This means that the live display output 40 is always a color 
picture display of the camera image. However, when the user switches to the 
frozen display output, the frozen image will always be displayed in a best 

15 mode for viewing the document (according to the mode control 34 selected by 
the user). The display operation indicated in Fig. 5 may be suited for 
applications which do not facilitate real-time OCR for a live text display mode. 

Figs. 6 and 7 illustrates the functionality for a second embodiment. The 
same reference numerals used in Figs. 6 and 7 to denote features equivalent 

20 to those described above. The functionality is similar to that of the first 
embodiment, except that a simplified display 32d is used having only a color 
picture display mode. Therefore, the output from the display is not controlled 
by the image mode control 34. However, the mode control 34 still controls 
which selection tool 28 and which copy tool 30 are used to suit the document, 

25 and to simplify operation by the user. 

It will be appreciated that the invention, particularly as illustrated by the 
preferred embodiments, can allow a clear and easy understanding of the user 
interface for a scanning tool. The displayed image can be well correlated with 
the information that is copied from the application to the computer's clipboard, 
30 or to a file. This can increase the productivity and usefulness of the scanning 
tool. 
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It will also be appreciated that the foregoing description is merely 
illustrative of preferred embodiments of the invention, and that many 
modifications may be made within the scope and spirit of the invention. 
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Apparatus for processing a captured image frame, the apparatus 
comprising: 

a) a plurality of selection tools for enabling a user to select a 
region of the image frame, the selection tools including at 
least one picture region selection tool and at least one text 
region selection tool; 

b) a plurality of copy tools for copying the selected region of 
the image frame, the copy tools including at least one 
picture copy tool and at least one text copy tool; and 

c) a mode control for controlling operation of the apparatus in 
at least one operating mode, the operating modes including 
at least one picture mode and at least one text mode; 

wherein the mode control is operative to select which of said 
selection tools and which of said copy tools are used for processing 
said image frame in accordance with said mode control. 

Apparatus according to claim 1 , wherein said selection tools include 
a rectangular box selection tool for a picture image, and a word-by- 
word selection tool for a text image. 

Apparatus according to claim 1, wherein said copy tools include a 
color picture copy tool, and a black-and-white picture copy tool. 

Apparatus according to claim 1, wherein the control modes include 
a color picture mode and a black-and-white picture mode. 

Apparatus according to claim 1 , further comprising a display and a 
display driver for generating a visual image of said frame, wherein 
the at least one of the display and the display driver is operable in a 
plurality of display modes, the display modes including at least one 
text mode and at least one picture mode, wherein the display mode 
is controlled by said mode control of the apparatus. 
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Apparatus according to claim 5, wherein the display modes include 
a color picture display mode and a black-and-white picture display 
mode. 

Apparatus according to claim 5, wherein the apparatus is operable 
to generate a live real time image and a frozen image, and said 
mode control is operable to control the display mode of at least the 
frozen image. 

A method of operation of a processor for processing a captured 
image frame, the processor comprising: 

a) a plurality of selection tools for enabling a user to select a 
region of the image frame, the selection tools including at 
least one picture region selection tool and at least one text 
region selection tool; 

b) a plurality of copy tools for copying the selected region of the 
image frame, the copy tools including at least one picture 
copy tool and at least one text copy tool; 

wherein the method comprises automatically selecting which of said 
selection tools and which of said copy tools are used for processing 
an image frame based on a mode control, said mode control 
including at least one picture mode and at least one text mode. 

A method according to claim 8, wherein the method comprises 
selecting a said text selection tool and a said text copy tool when 
said control mode corresponds to a text mode, and selecting a said 
picture selection tool and a picture copy tool when said control 
mode corresponds to a picture mode. 

A method according to claim 8, wherein said selection tools include 
a rectangular box selection tool for a picture image and a word-by- 
word selection tool for a text image. 

A method according to claim 8, wherein said copy tools include a 
color picture copy tool, and a black-and-white picture copy tool. 
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12. A method according to claim 8, wherein the control modes include a 
color picture mode and a black-and-white picture mode. 

13. A method according to claim 8, further comprising controlling 
operation of a display in one of a plurality of display modes, the 

5 display modes including at least one text mode and at least one 

picture mode, wherein the display mode is controlled by said mode 
control. 

14. A method according to claim 13, wherein the display modes include 
a color picture display mode and a black-and-white picture display 

10 mode. 

15. In a processor for processing a captured image, the improvement 
comprising automatic selection of one of a plurality of selection 
tools, and selection of one of a plurality of copy tools, based on a 
global mode setting, the global mode setting including at least one 

15 text mode and at least one picture mode. 

16. The improvement according to claim 15, wherein the global mode 
settings include a color picture mode and a black-and-white picture 
mode. 

17. The improvement according to claim 15, further comprising 
20 automatic selection of a display mode based on said global mode 

control. 
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ABSTRACT OF THE DISCLOSURE 

An apparatus and method are described for processing a captured 
(e.g. scanned) image. The apparatus includes a plurality of selection tools 
for selecting a region of the image to be processed. The selection tools 
include a word-by-word selection tool for text and a rectangular box 
selection tool for a picture. The apparatus also includes a plurality of copy 
tools for copying the selected region. The appropriate selection tool and 
copy tool are controlled automatically by a global mode control, being one 
of a text mode, a color picture mode and a black-and-white picture mode. 
Optionally, the apparatus displays the image in one of a plurality of 
different display modes, the display mode also being controlled by the 
global mode control. 
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